robert fidler has lived in castle in salfords , surrey , since 2002 with family .
used bales of hay to disguise the building before unveiling it in 2006 .
tried to exploit loophole that allows building if no complaints for four years .
66-year-old must now demolish the four-bedroom house worth £ 1million .